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Abstract — We analyze a multi-level MIMO relaying system 
where a multiple-antenna transmitter sends data to a multiple- 
antenna receiver through several relay levels, also equipped with 
multiple antennas. Assuming correlated fading in each hop, each 
relay receives a faded version of the signal transmitted by the 
previous level, performs precoding on the received signal and 
retransmits it to the next level. Using free probability theory and 
assuming that the noise power at the relay levels - but not at the 
receiver - is negligible, a closed-form expression of the end-to-end 
asymptotic instantaneous mutual information is derived as the 
number of antennas in all levels grow large with the same rate. 
This asymptotic expression is shown to be independent from the 
channel realizations, to only depend on the channel statistics and 
to also serve as the asymptotic value of the end-to-end average 
mutual information. We also provide the optimal singular vectors 
of the precoding matrices that maximize the asymptotic mutual 
information : the optimal transmit directions represented by the 
singular vectors of the precoding matrices are aligned on the 
eigenvectors of the channel correlation matrices, therefore they 
can be determined only using the known statistics of the channel 
matrices and do not depend on a particular channel realization. 



I. Introduction 

Relay communication systems have recently attracted much 
attention due to their potential to substantially improve the 
signal reception quality when the direct communication link 
between the transmitter and the receiver is not reliable. Due to 
its major practical importance as well as its significant techni- 
cal challenge, deriving the capacity - or bounds on the capacity 
- of various relay communication schemes is growing to an 
entire field of research. Of particular interest, is the capacity 
bounds for the systems in which the transmission, reception, or 
the relay levels are equipped with multiple antennas. Assuming 
fixed channel conditions, lower and upper bounds on the 
capacity of multiple-input multiple output (MIMO) two-hop 
relay channel have been derived in [1]. Similar bounds have 
also been obtained in the same paper on the ergodic capacity 
when the communication links undergo i.i.d. Rayleigh fadings. 
For a two-hop relay system and the case when the source- 
relay and the relay-destination channel matrices are perfectly 



known, the optimal relay precoding matrix is derived in [2]. In 
[3] the asymptotic capacity of MIMO two-hop relay networks 
has been studied when the number of relay nodes grows to 
infinity while the number of transmit and receive antennas 
remain constant. The asymptotic capacity of the MIMO multi- 
hop amplify-and-forward relay channels has been derived in 
[4] when all channel links experience i.i.d. Rayleigh fading 
while the number of transmit and receive antennas as well 
as the number of relays at each hop go to infinity with the 
same rate. The scaling behavior of the capacity of MIMO 
two-hop relay channel has also been studied in [5] for the 
case when the source and destination jointly communicate to 
each other through the relay layer. Other related problems have 
been analyzed in, for instance, [6], [7], [8], [9]. 

In this paper we study MIMO A-hop relay communication 
system wherein data transmission from fco transmit antennas 
to fc/v receive antennas is made possible through N — 1 relay 
levels each of which are equipped with fcj , i = 1, . . . , N — 1 
antennas. In this transmission chain of N + 1 levels it is 
assumed that the direct communication link is only viable 
between two adjacent levels: Each relay receives a faded 
version of the multi-dimensional signal transmitted from the 
previous level and, after precoding, retransmits it to the next 
level. We consider the case where all communication links 
undergo Rayleigh flat fading and the fading channels in each 
hop (in-between two adjacent levels) may be correlated while 
the fading channels of any two different hops are uncorrelated. 
Using the tools from free probability theory and assuming that 
the noise power at the relay levels, but not at the receiver, is 
negligible, we derive a closed-form expression for the end- 
to-end asymptotic instantaneous mutual information between 
the transmitter and the receiver as the number of antennas 
in all levels grows large with the same rate. This asymptotic 
expression is shown to be independent from the channel real- 
izations and only depends on the channel statistics. Therefore, 
as long as the statistical properties of the channel matrices at 
all hops do not change, the instantaneous mutual information 
asymptotically converges to the same deterministic expression 
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Fig. 1. Multi-level Relaying System 



for any arbitrary channel realization. As a consequence, the so- 
obtained expression also serves as the asymptotic value of the 
end-to-end average mutual information between the transmitter 
and the receiver. Then we obtain the optimal singular vectors 
of the precoding matrices that maximize the asymptotic mutual 
information. It is shown that, in the asymptotic regime, the 
optimal singular vectors of the precoding matrices are also in- 
dependent from the channel realizations and can be determined 
only using the known statistics of the channel matrices. 

The rest of the paper is organized as follows. In section 
ITTl notations and the system model are presented. In section 
inil the end-to-end instantaneous mutual information in the 
asymptotic regime is derived, whereas the optimal singular 
vectors of the precoding matrices are given in section |IV] 
Numerical results are provided in section [V] and lead to the 
concluding section IVTl 

II. System Model 

Matrices and vectors are represented by boldface uppercase. 
A T , A*, A H denote the transpose, the conjugate and the 
transpose conjugate of matrix A. tr(A), det(A) and ||A||j? = 

\J tr (AA H ) stand for trace, determinant and Frobenius norm 
of A. Ijv is the identity matrix of size N. 

Consider Fig. Q] that shows a multi-level relaying system 
with k transmit antennas, k^ receive antennas and N — 1 
relaying stages. The i— th relay stage is equipped with fej 
antennas. We assume that noise power is zero at all relays 
while at the receiver we have 

E{zz H } = a 2 I = -I (1) 
V 

where z is the circularly-symmetric zero-mean iid Gaussian 
receiver noise vector. This simplifying non-noisy-relays as- 
sumption is a first step toward more complete analysis where 
noisy relays will be considered in future work. (Remark: in 
[9] a multi-level AF relay network with iid Rayleigh fading 
is analyzed at high SNR and it is shown that at high SNR 
the colored noise at destination can be considered as white, 
which is equivalent to neglecting the noise at relays but not at 
the destination.) Channel matrices are given by the Kronecker 
model: 

H i = C 1 r / tl 2 ® i C 1 t ( 2 i = l,...,N (2) 

where j, C rj j are the transmit and receive correlation matri- 
ces and &i are zero-mean iid Gaussian matrices, independent 



from each other. Moreover, denoting [©ijjw the (k, I) entry of 

E{|[© 4 H 2 } = T i = l,...,N (3) 

The signal transmitted by the transmitter is Xo = Poyo 
where yo is a circularly-symmetric zero-mean iid Gaussian 
signal vector such that E{yoy(f} = I. 

Relay at level i performs linear precoding on its received 
signal, by multiplying the received vector by a precoding 
matrix to form its transmitted signal. Therefore the vectors 
transmitted by the relays Xj,2 = 1, . . . ,N — 1 are given by: 

x, = P tYl i = 0, . . . , N - 1 (4) 

where y^ , i = 1, . . . , N — 1 are the signals received at 
each relaying level, and P;, are to-be-determined precoding 
matrices, respecting the per-node average power constraints: 

<r(E{x,xf }) < V l i = 0,...,N-l (5) 

Amplify-and-Forward is a particular case where the precoding 
matrix is diagonal. 

According to Fig. Q] the signal received at the final receiver 
can be represented by 

y N = HjvPjv-iHAr_iPjv-2 . . .H 2 PiHiP y + z 

= G w yo + z (6) 

where 

Gn =H7vPn-iHat_iPjv-2 • ■ ■ H 2 PiHiP 
x C^ 2 2 C t 1 i / 2 2 P 1 C^ 1 2 1 C t 1 / 2 P o 

(7) 

We define the matrices : 

M, - C^P.C^ 2 < = 1,...,JV-1 
M = C^Po 

M N = C$. (8) 

and can then rewrite (Q as: 

G N = M J v@jvM J v-i@jv-i---M 2 02Mi0iMo (9) 

The dimensions of the matrices/vectors that are involved in 
our analysis are given below: 

Xj : ki x 1 yj : k. t x 1 P^ : ki x ki 

Hi '. ki x ki—i G r i \ ki x ki : ki— i x 

®i : ki x ki-i Mi : fc, x ki 



III. Asymptotic Mutual Information 

In this section, we derive a closed-form expression for 
the end-to-end asymptotic instantaneous mutual information 
between the transmitter and the receiver as the number of 
antennas in all levels grows large with the same rate. In 
other words, we find the asymptotic instantaneous mutual 
information per dimension J 



J = llogdet(I + r ? Gi V G^) 
k 
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when fco, . . . , fc;v go to infinity while 

k N 

The main result is summarized in the following theorem: 

Theorem 1: For the system described in section [II] as 
ko, ki, . . . , fcj\r go to infinity while -j^- — > pi,i — 0, . . . , N 
the asymptotic end-to-end instantaneous mutual information 
per dimension I is given by 

N , / x x , N 



<^ log 1 



h? A, 



A 



loge 



i=0 

(12) 

where ho, hi, . . . , hw are the solutions of the system of A+ 1 
equations 



N 



J hj = Pi E 



3=0 



hf K: 



Pi+i +r}hf A 



i = 0, 



and where E is over A, with distribution F, 



,N (13) 



(A) 



The proof of this theorem uses tools from free probability 
theory. After introducing a few transformations and lemmas, 
we provide hereafter the main steps of the proof of Theorem 
[JJ For the full proof, the reader is referred to [10]. 

Before giving a sketch of the proof, we would like to point 
out that this expression of the asymptotic instantaneous mutual 
information is valid for any arbitrary set of matrices Pj. 

Moreover this asymptotic expression depends only on the 
channel statistics and not on a particular realization of the 
channel. Thus when the size of the system gets large, by 
knowing only the statistics of the channel and not the in- 
stantaneous channel realization, it is still possible to optimize 
the instantaneous mutual information, making Theorem [T] a 
powerful tool for optimizing the system performance. Actually, 
it is a powerful optimization tool even for a small number 
of antennas. Indeed as illustrated in section [V] experimental 
results show that the system behaves like in the asymptotic 
regime even for a small number of antennas. In other words, 
the asymptotic mutual information can be used to optimize the 
instantaneous mutual information of a finite-size system when 
transmitting nodes know only the statistics of the channel (the 
receiver is assumed to know the channel). 

Finally, since the asymptotic mutual information depends 
only on channel statistics, as long as the statistical properties of 
the channel matrices do not vary at all hops, the instantaneous 
mutual information converges asymptotically to the same 



deterministic expression for any arbitrary channel realization. 
As a consequence, the asymptotic instantaneous end-to-end 
mutual information is also the asymptotic value of the average 
end-to-end mutual information. 

A. Preliminaries 

To prove Theorem [JJ we need to introduce the following 
transformations [6]: 

sA 



sA 



dF T {\) 



(14) 



St(z) 



1 



T T 1 (z) , S-transform (15) 



where T is a Hermitian matrix, Ft is the asymptotic eigen- 
value distribution of T as its dimensions go to infinity and 
T- 1 (T(s)) = s. 

Finally, we need the following lemmas: 

Lemma 1 ( [6, Eq.(15)]): Given an m x n matrix A with 
- =£ 

m / \ 

Saah{z) = -^-^S a h a ( -J (16) 

Lemma 2 ( [11]): Let be a zero-mean iid Gaussian 
matrix and Ti and T2 be Hermitian matrices independent 
from © and with proper dimensions such that 0Ti© ff T2 
is meaningful. Then, as the dimensions of the matrices go to 
infinity, ®Ti@ H and T2 become asymptotically free, thus, 

S&Ti®"^ (z) = S @Tl@H (z)St 2 (z) (17) 
Lemma 3 ( [6, Theorem 1 ]): Consider an m x n matrix B 
with zero-mean iid entries with variance —. Assume that the 
dimensions go to infinity while ^ — > f, then 

SbbHz) = YT(-z (18) 
B. Main Steps of proof of Theorem Q] 

The proof of Theorem\T\goes through four steps as follows: 
• First step : Obtain S G g h(z) 

Using Lemmas [7] \3\ [2] we show the following theorem: 

Theorem 2: As hi, i = 0, . . . , N go to infinity with the 
same rate, the S-transform of GjyG^ is given by: 



(19) 

. Second step : Use S GnG h(z) to find T GjvG h(z) 

Theorem 3: Let us define pn+i = L We have 



N 



sT G„G«( S ) =II^+ lT A/W t 



-GjyGg(s) 
Pi 

• Third step : Use T GnG h(z) to obtain dl/dr]. 
First we note that 



(20) 



h 1 ^ N 

2L-L£]og(l + f7 A,(G*G5)) 
ko k N f-f 

^/ lo g(l + ^X- G „(A) 

- f\og(l+ v \)dF GNG H(X) (21) 
Po J 



where „ H (A) is the empirical (non-asymptotic) 
eigenvalue distribution of GtvG^. Due to d2TT i, in the 
asymptotic regime, the derivative of the mutual informa- 
tion with respect to 77 is linked to T GjvG h(z): 

? = V^ t g„g«(-^)- (22) 

Thus using Theorem [3j we show the following theorem: 

Theorem 4: In the asymptotic regime, as ko, k\, . . . , fejv 
go to infinity while j*- — > p.;, i = 0, . . . , N, the derivative 
of the instantaneous mutual information is given by: 

dl 1 A 

-r- = — nj]J> (23) 

where ho,hx, . . . ,h,N are the solutions of the system of 
TV + 1 equations 

N ( h N \ ~\ 

(24) 

The expectation is over with distribution F M a M .(A). 
• Fourth step : Integrate dl/dr/ to get I 

Since primitive functions of ^ differ by a constant, the 
constant was chosen such that the mutual information 
( TT2l is null when SNR 77 goes to zero : lim^_,o I (v) = 0- 

IV. Optimal Transmission Strategy at Source and 
Relays 

In previous section, the asymptotic mutual information H2i . 
(fT3T l was derived considering arbitrary precoding matrices 
Pi, i £ {0, . . . , N — 1}. In this section, we analyze the optimal 
linear precoding strategies Pj, i <E {0, . . . , N — 1} at source 
and relays that allow to maximize the mutual information. 

We characterize the optimal transmit directions, meaning the 
singular vectors of the precoding matrices at source and relays, 
that maximize the asymptotic mutual information. It turns out 
that those transmit direction are also the ones that maximize 
the average mutual information of finite size systems, i.e. when 
ko,ki,...,kif are finite. In future work, using the results 
on the optimal directions of transmission and the asymptotic 
mutual information (1121 1. (1131 1. we intend to work out the 
optimal power allocation in the asymptotic regime. 

The main result of this section is given by the theorem: 

Theorem 5: For i 6 {l,...,N} let C M = U M A M U^ 
and C r i = U r iA r iU^ be the eigenvalue decompositions 
of the covariance matrices Ctj and C r ,i , where U t ,i and 
U rj i are unitary and A t .i and A r i are diagonal, with their 
respective eigenvalues ordered in decreasing order. Then the 
optimal linear precoding matrices, that maximize the asymp- 
totic mutual information under power constraints (0 can be 
written 

Po = U M A Po 

P, = i;,.,. :A,.U,", , for i 6 {1, . . . , N - 1} 



where Ap i are diagonal matrices with complex elements. 
Moreover, those precoding matrices are also the ones which 
maximize the average mutual information of a finite size (non- 
asymptotic) system. 

This theorem means that the transmit directions at source 
and relays maximizing the asymptotic mutual information are 
such that: 

• the source should align the transmit covariance matrix 
Q = PoPq^ on the eigenvectors of the transmit correla- 
tion matrix of the channel Hi to the first relaying layer 

• relay i should align the precoding matrix P^ on the 
eigenvectors U r ,i of receive correlation matrix of channel 
H; on the right, and on the eigenvectors XJ t .i+i of the 
transmit correlation matrix of channel H^+i on the left. 

• the problem of optimizing P^ can be divided into two 
decoupled problems: optimizing the transmit directions 
on one hand, and optimizing the transmit powers on the 
other hand. 

For a detailed proof of Theorem [5] we once again refer the 
readers to [10]. Nevertheless, we would like to draw the 
attention of the reader on two points. 

First, the proof of this theorem does not rely on the 
expression of the asymptotic mutual information given in dTZb 
and is independent of Theorem\T\ On the contrary, the theorem 
is first proved for the non-asymptotic regime, and the result is 
shown to still hold in the limit when the dimensions increase. 
Nevertheless by combining Theorem \T\ and Theorem [5] the 
ultimate objective is to find the optimal precoding matrices 
using only knowledge of the statistics of the channel. 

Second, as in the proofs in [12] for the average mutual in- 
formation of multiple-antenna single-user case with covariance 
knowledge at transmitter, or in [13] for the average mutual 
information in the multiple-antenna multi-user case also with 
covariance knowledge at transmitter, both without relaying, or 
in [2] for the two-hop relay system with full CSI at the relay, 
our proof of Theorem [5] is based on Theorem H.l.h in [14]. 

V. Numerical Results 

In this section, we present numerical results to validate 
Theorem \T\ and to show that even for a small number of 
antenna, the behavior of the system is close to the behavior 
in the asymptotic regime, making Theorem \T\ a useful tool for 
optimization of finite-size systems as well as large networks. 

Fig. [2] plots the asymptotic mutual information from Theo- 
rem 1 as well as the instantaneous mutual information obtained 
for an arbitrary channel realization ('experimental' curves) 
for a system with 10 antennas at transmitter, receiver and 
each relay level, and 1,2 or 3 hops, the case N = 1 hop 
corresponding to a MIMO channel. Fig. [3]plots the same type 
of curves, for a system with 100 antennas at each levels. 
Equal power allocation, i.e. matrices Pi proportional to the 
identity matrix, as well as non-correlated channels, i.e. channel 
correlation matrices all equal to identity, were considered in 
these simulations, whose purpose is mainly to validate the 
formula in Theorem Q] not to optimize the system. We would 
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Fig. 2. Asymptotic Mutual Information and Instantaneous Mutual Informa- 
tion with K = 10 antennas, for MIMO, 1 relay level, and 2 relay levels 

like to point out that plotting the experimental curves for dif- 
ferent channel realizations gave similar results, and that for the 
sake of clarity and conciseness, we exhibit the experimental 
curves only for one realization. Fig.[3]shows the perfect match 
between the instantaneous mutual information of arbitrary 
channel realization and the asymptotic mutual information, 
validating the formula for large dimensions of the network. 
On the other hand Fig. [2] shows that the instantaneous mutual 
information of a system with a small number of antennas 
behaves very closely to the asymptotic regime, justifying the 
usefulness of the asymptotic formula even for optimizing 
systems with small dimensions. 

VI. Conclusion 

We studied a multi-level MIMO relay network, in corre- 
lated fading, where relays perform linear precoding on their 
received signal before retransmission. On one hand, using 
free probability theory, we derived a closed-form expression 
of the end-to-end instantaneous mutual information in the 
asymptotic regime when the number of antennas at all levels 
goes to infinity with same rate. This expression turns out to 
depend only on channel statistics and not on particular channel 
realizations. We also showed that multi-level networks with 
finite dimensions behave closely to the asymptotic regime, 
even for a small number of antennas, making the asymp- 
totic mutual information a powerful tool for optimizing the 
instantaneous mutual information of finite dimensions systems 
with only statistical knowledge of the channel. On the other 
hand, we showed that the precoding matrices that maximize 
the asymptotic mutual information, have a particular form: 
the precoding matrices, through their singular vectors, must 
be aligned on the eigenvectors of the channel transmit and 
receive correlation matrices. Combining asymptotic mutual 
information and optimal directions of transmissions, future 
work will focus on optimizing the power allocations, so as to 
find the precoding matrices optimizing the mutual information 
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Fig. 3. Asymptotic Mutual Information and Instantaneous Mutual Informa- 
tion with K = 100 antennas, for MIMO, 1 relay level, and 2 relay levels 



with only statistical channel knowledge. 
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